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Title: 3D NAVIGATION TECHNIQUES 

Technical Field 

The present invention relates to user interactive three-dimensional (3D) 
workspaces and in particular to a system and method for navigating, searching and 
inspecting within a 3D environment. 

Background of the Invention 

Most virtual environments include more space than can be viewed from a single 
focal point. Therefore, a 3D world is only as useful as a user's ability to move around 
and interact with information within that world. Users must be provided with the ability 
to navigate through the environment in order to obtain different views to investigate 
various scenes and objects within the virtual surroundings. The most common techniques 
of navigating through a 3D virtual world are computer mouse or joystick driven 
techniques. Forward or backward movement of a computer mouse or joystick provides 
the user with the illusion of moving a virtual body or camera forward or backward 
through the virtual environment. Left or right movement turns the body or camera left or 
right in the virtual environment. The virtual body or camera changes in position or 
orientation within the 3D graphical workspace to give the user a sensation of moving 
within the 3D graphical space. The problem is that if an object that the user desires to 
reach is a long distance from the location of the virtual body or camera, it takes a long 
time for the user to get to the object unless a built in acceleration mechanism is provided. 
The problem with built in acceleration mechanisms, is that the user has the tendency to 
overshoot the object and then must backtrack to the location of the object. 

Numerous techniques have been employed to try to maximize the utility of display 
space to view existing information within the 3D environment. For example, in some 
virtual environment applications, the user is given the ability to zoom in and out and work 
at multiple scales for virtually expanding the viewing space. Mechanisms have been 
provided to allow a user to navigate through a space by modifying a search area in each 
view, or where the principle means for navigating is by employing a zooming feature in a 
user graphical interface. Other systems have been employed that provide a user 
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simultaneous overlaying of both global and local views. Scaling techniques and 
transporting techniques have been developed to allow a user to move quickly to different 
locations in an environment. Typically, these systems require a user to work within or 
between two different unconstrained coordinate systems. Information visualization 
5 techniques are another mechanism for expanding the navigable space by distorting the 
views of the world. These techniques are sometimes disorienting and place additional 
cognitive load on the user to mentally re-map the spatial relations. 

One particular technique referred to as "a point of interest technique" has proved 
relatively successful in providing a user with a mechanism to navigate easily through a 

10 3D virtual world. The point of interest technique allows a user to focus on an object and 
to move toward that object automatically. System users can have arbitrary positions and 
orientations in each workspace and techniques are provided for rapidly controlled and 
targeted three dimensional movement by the user in the workspaces, such as the 
technique disclosed in U.S. Pat No. 5,276, 785 to Mackinlay et al, entitled "Moving 

1 5 Viewpoint with Respect to a Target in a Three Dimensional Workspace." The viewpoint 
of the user {e.g., a virtual camera) can approach the point of interest {e.g., an object 
within the environment) asymptotically, with both radial and lateral motion. When the 
user requests viewpoint motion toward the point of interest, the system can provide 
animated motion so that the object constancy is preserved. 

20 The problem with the point of interest technique and other information 

visualization techniques for navigating in a 3D environment is that the object must be in 
the user's field of view for the user to navigate to the object. Additionally, the user is 
presented with a predetermined forward face and vector normal to the face upon 
navigating to the object. A user may move around and inspect the object by 

25 simultaneously holding down both a forward and backward key. This has proven to be 
difficult and awkward for users when inspecting the object. Furthermore, the user is not 
able to navigate with a single motion of the input device. 

Accordingly, there is an unmet need in the art for a system and method for 
providing improved navigation techniques to facilitate user interactions with a given 
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visual metaphor in order to achieve a higher level of ease of use for a user navigating 
through a virtual world. 

Summary of the Invention 

5 The following presents a simplified summary of the invention in order to provide 

a basic understanding of some aspects of the invention. This summary is not an extensive 
overview of the invention. It is intended to neither identify key or critical elements of the 
invention nor delineate the scope of the invention. Its sole purpose is to present some 
concepts of the invention in a simplified form as a prelude to the more detailed 

1 0 description that is presented later. 

A system and method is provided for facilitating navigation techniques in a 3D 
virtual environment. The navigation technique employed considers the subtasks of 
exploration, search, inspection and object manipulation. The exploration subtask is 
employed to gain survey knowledge, the search subtask is employed to locate an object or 

1 5 route and to travel to it and the inspection subtask is to establish and maintain a particular 
view of an object. The manipulation subtask is employed to select and carry objects in 
the environment. The present invention provides techniques to navigate an animated 
camera through a 3D navigable workspace or environment, search and move to objects in 
the 3D environment and inspect and carry objects within the navigable workspace. The 

20 present invention employs a task-based taxonomy to determine travel control of the user 
with respect to viewpoint motion specified by position, orientation and speed of a virtual 
camera through a virtual environment. The present invention couples input driving 
techniques to the state of one or more workspace variables (e.g., object state, virtual body 
state, environment state) to change the user's viewing context within a single input 

25 control motion. Modification of the user's viewing context allows navigation to various 

positions and orientations without the need to be provided with that viewing context prior 
to navigation. Additionally, the change in the user's viewing context can occur over time 
upon deselection of the one or more workspace variables, so that the user is made aware 
of the change in position and orientation of the viewing context. 
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One aspect of the invention couples speed control to height position and tilt 
control of a virtual body or camera to give the user the ability to transition between and 
navigate within local and global views of a 3D world. In this technique, the user is 
equipped with standard egocentric driving controls, such as dragging a pointer 

5 forward/backward in order to move the camera forwaraVbackward and dragging the 

mouse left/right to turn the camera left/right. The driving controls are coupled to the state 
of the virtual body or camera, so that the state of the virtual body or camera within the 
environment can be controlled. Additionally, the user's forward speed is coupled to the 
camera's viewing height and angle. The faster the user moves forward, the higher the 

1 0 camera moves providing a zoomed out view of the environment. The coupling of the 
speed to height and tilt keeps the visual flow across the screen constant in an effort to 
allow the user to move and locate distant targets quickly. As the user slows down or 
releases the button, the camera glides down forward to the ground and eventually lands at 
a point at the bottom of a viewing frustum. The technique also includes an object 

1 5 inspection technique or orbiting technique. The object inspection technique allows a user 

to select an object for inspection by selecting the object, for example, by holding down 
the button and dragging on the object with a pointer. The object is then moved to the 
center of the screen. The user can then orbit the object by dragging the pointer left/right 
and move to and from the object by dragging the pointer forward/backward. 

20 In another aspect of the invention, an object manipulation technique allows users 

to specify objects in the environment toward which they would like to move. The 
technique is a function of object state position and orientation since the user is moved 
directly to the target destination. The object manipulation technique allows a user to drag 
on an object and manipulate a copy of the object placing it in a selected position and 

25 orientation. The copy fades away upon release of the button and the camera animates to a 

desired viewing context of the object. In another navigation technique, the user can drag 
and manipulate multiple copies of an object so as to get multiple simultaneous viewing 
contexts of the object and the environment. The copies are destroyed when the user 
moves away or selects another object to view. Another navigation technique allows the 

30 user to select an object to move to the exact position and orientation of the object thereby 
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possessing it and seeing the world from the point of view of the object. 

In yet another aspect of the invention, a navigation technique is employed that 
allows a user to manipulate the environment and object within the environment by 
controlling the radius of a circle or sphere centered on the user. Objects are either made 

5 transparent or scaled down, so as to reduce the amount of occlusion that objects within 
the radius present. The closer to the center of the sphere, the more transparent or smaller 
the objects are viewed. This allows users to scan through worlds very quickly by simply 
pivoting or turning and removing occlusions so as to see objects that are different 
distances away. A compression technique is provided that gives the user the ability to 

1 0 scale the state of the environment in a compressed single view. The entire world can be 
scaled down so the user gets an overview of the world. Alternatively, the user can 
compress the world radially around the camera so that all objects fit within the viewing 
context. The user can then navigate within the scaled down world or return the world to 
normal. 

1 5 To the accomplishment of the foregoing and related ends, the invention then, 

comprises the features hereinafter fully described and particularly pointed out in the 
claims. The following description and the annexed drawings set forth in detail certain 
illustrative embodiments of the invention. These embodiments are indicative, however, 
of but a few of the various ways in which the principles of the invention may be 

20 employed and the present invention is intended to include all such embodiments and their 
equivalents. Other objects, advantages and novel features of the invention will become 
apparent from the following detailed description of the invention when considered in 
conjunction with the drawings. 

25 Rrief Descri ption of the Drawings 

Fig. 1 illustrates a block diagram of a 3D navigation system in accordance with 
one aspect of the present invention. 

Fig. 2 illustrates a 3D schematic view of a virtual body having a local view of a 
3D environment in accordance with one aspect of the invention. 
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Fig. 3 illustrates a 3D schematic view of the virtual body having a global view of 
the 3D environment of Fig. 2 in accordance with one aspect of the invention. 

Fig. 4 illustrates a side view of the virtual body navigating through a 3D 
environment in accordance with one aspect of the invention. 
5 Fig. 5 illustrates a side view of the virtual body gliding down to a ground plane of 

the 3D environment of Fig. 4 in accordance with one aspect of the invention. 

Fig. 6 illustrates a top plan view of a virtual body orbiting around an object in 
accordance with one aspect of the invention. 

Fig. 7 illustrates a 3D schematic view of a virtual body navigating by object 
1 0 manipulation in accordance with one aspect of the invention. 

Fig. 8 illustrates a top plan view of a virtual body navigating by object 
manipulation in accordance with one aspect of the invention. 

Fig. 9 illustrates a top plan view of a virtual body navigating by creating multiple 
viewing contexts in accordance with one aspect of the invention. 
1 5 Fig. 1 0 illustrates a top plan view of a virtual body navigating by object 

possession in accordance with one aspect of the invention. 

Fig. 1 1 illustrates a 3D schematic view of a virtual body manipulating a viewing 
context by making objects transparent within a radius centered on the virtual body in 
accordance with one aspect of the invention. 
20 Fig. 12 illustrates a 3D schematic view of a virtual body manipulating a viewing 

context by making objects smaller within a radius centered on the virtual body in 
accordance with one aspect of the invention. 

Fig. 13 illustrates a top plan view of a virtual body within a 3D environment in 
accordance with one aspect of the invention. 
25 Fig. 14 illustrates a front view of a viewing context of the virtual body within the 

3D environment of Fig. 13 in accordance with one aspect of the invention. 

Fig. 15 illustrates a front view of an adjusted viewing context of the virtual body 
within the 3D environment of Fig. 13 after the 3D environment is compressed in 
accordance with one aspect of the invention. 
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Fig. 16 illustrates a block diagram of a processor driven 3D navigation system in 
accordance with one aspect of the invention. 

Fig. 17 illustrates a flow diagram of a methodology for navigating through a 3D 
environment in accordance with one aspect of the present invention. 
5 Fig. 1 8 illustrates a local view of a 3D amusement park in an Alice environment 

in accordance with one aspect of the present invention. 

Fig. 19 illustrates a global view of the 3D amusement park in the Alice 
environment using the speed-coupled flying technique in accordance with one aspect of 
the present invention. 

1 0 Fig. 20 illustrates a local view of the 3D amusement park in the Alice 

environment after gliding down to a ground plane in front of an object using the speed- 
coupled flying technique in accordance with one aspect of the present invention. 

Fig. 21 illustrates a block diagram of a computer system in accordance with an 
environment of the present invention. 

15 

Detailed Description of the Invention 

The present invention is now described with reference to the drawings. The 
present invention is described with respect to a system and method for navigating through 
a three-dimensional (3D) environment by providing a user with continuous viewpoint 

20 control by coupling input device controls to a state of one or more workspace variables. 

The state of one or more workspace variables refers to the position, orientation, 
ephemeral state, size and other variables associated with a workspace variable. This 
allows a user to manipulate a state of a workspace variable (e.g., object state, 
environment state, virtual body state) from a first viewing context, and to employ that 

25 manipulated state to change the viewing context as experienced by the user. The viewing 

context can be defined as the field of view of the environment and objects within the 
environment as experienced by the user. 

Fig. 1 illustrates an example of a 3D navigation system 10 in accordance with an 
aspect of the present invention. The 3D navigation system 1 0 includes an input drive 

30 control system 14 with various input variables. The input variables include speed data 
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16, position data 18 and select/deselect data 20 with respect to movement and selections 
by an input device {e.g., a mouse pointer, joystick). The 3D navigation system 10 also 
includes a workspace control system 24 with various workspace variables. The 
workspace variables include object state(s) 26, environment state 28 and virtual body 

5 state 30. Each workspace variable can be manipulated and coupled to the input driving 
control system 14 through a travel control system 22. The travel control system 22 
determines which workspace variables to couple to the input drive control system 14 
employing a navigation type 32. The travel control system 22 determines an initial 
viewing context 12 that a virtual body or camera experiences based on the initial state of 

1 0 the virtual body 30, the 3D environment state 28 and object states 26 within the 3D 

environment. The travel control system 22 then couples the drive control system 14 to 
one or more workspace variables. The one or more workspace variables can then be 
manipulated and employed to change the viewing context 12 experienced by the user via 
the virtual body or camera and allow continuous viewpoint control. 

1 5 The navigation type can be determined in a variety of manners. For example, 

functions keys on the keyboard can be provided to allow a user to select the navigation 
type. Alternatively, the user can be provided with a menu of navigation types by 
invoking a function key on a keyboard, right clicking on a computer mouse pointer or a 
selectable button on a joystick. Furthermore, menus or selections can be provided within 

20 the virtual environment and selected by the user via an input device. The navigation 

type can also be invoked automatically. For example, dragging within the environment 
can invoke one navigation type and dragging on an object can invoke another navigation 
type. 

Figs. 2 and 3 illustrate a navigation technique (hereinafter referred to as "speed- 
25 coupled flying) in a 3D environment in accordance with one aspect of the invention. As 
illustrated in Fig. 2, a virtual camera or virtual body 42 has a viewing point specified by 
the position and orientation of the virtual body 42 into the 3D environment 40. The 
virtual body 42 has a viewing frustum 44 such that a viewing context includes objects 46 
that are viewable horizontally within the viewing frustum 44. Other objects 48 reside in 
30 the 3D environment 40 but are not within the field of view of the virtual body 42. 
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Speed-coupled flying includes coupling the input drive control system 14 to the virtual 
body state 30. In this particular technique, the state of the virtual body 42 is coupled to 
the input drive control system 14, such that the position and orientation of the virtual 
body 42 is varied based on changes in the input variables of the input drive control 

5 system 14. In speed coupled flying, the speed of which the input device is moved in a 

forward direction is coupled to the height or position of the virtual body 42 within the 
3D environment 40 and the tilt or orientation of the virtual body 42. Speed-coupled 
flying gives the user the ability to transition seamlessly between and navigate within 
local as well as global views of the 3D environment 40. 

1 o The user can be provided with standard egocentric driving controls in the speed- 

coupled flying technique. The speed-coupled flying technique can be invoked using 
function keys on a keyboard, by employing a selectable menu or by invoking the select 
input 20 of the input device and dragging within the environment. Dragging the input 
device forward/backward moves the virtual body 42 forward/backward, while dragging 

1 5 the input device from the left/right turns the virtual body 42 left/right. Additionally, the 

user's speed is coupled to the viewing height and angle of the virtual body 42. The 
faster the input device is moved in the forward direction, the higher the virtual body 42 
moves giving the user a zoomed out overview of the 3D environment 40. As illustrated 
in Fig. 3, the virtual body 42 rises above the objects 46 and 48 providing an overview of 

20 the 3D environment 40 and causing objects previously unviewable to fall within the 

viewing frustum 44 of the virtual body 42. As the state of the virtual body 42 changes, 
the viewing context 12 of the user is constantly updated, so that the user appears to be in 
motion. Coupling speed to height and tilt keeps the visual flow across the screen 
constant allowing the user to move and locate distant targets quickly. The user can 

25 employ the input device in steering the virtual body over the environment by moving the 

input device left/right while moving in the forward direction. 

As described above, the faster a user moves the input device the faster the 
viewing context 12 within the viewing domain moves, the higher the position of the 
virtual body 42 within the 3D environment 40 and the steeper angle of the viewing 

30 frustum 44 of the virtual body 42. However, it is to be appreciated that in some 
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circumstances, if the virtual body 42 is moved too high objects within the viewing 
frustum 44 will appear too small to be discernible. Therefore, in one aspect of the 
invention a height limit is selected based on the viewing environment size and the size of 
the objects in comparison to the viewing environment. 
5 Fig. 4 illustrates a 3D environment 60 with a virtual body 64 and an object 66. 

The 3D environment is illustrated within two dimensions for the purpose of simplicity. 
The virtual body 64 begins with a viewing context with respect to a ground surface or 
plane of the 3D environment. As the height of the virtual body 64 is increased and the 
tilt of the virtual body increases, different viewing contexts of the object 66 and the 3D 
1 0 environment are provided to the user. Eventually, the height of the virtual body 64 is 
limited by a ceiling 62. The ceiling 62 is determined based on the size of the 3D 
environment 60 and the size of the object 66 with respect to the size of the environment. 
The user can then control the height of the virtual body by speeding up or slowing down 
the virtual body. As the user slows down or releases a selection button corresponding to 
1 5 the select/deselect input variable, the virtual body 64 glides back down to the ground or 

the level it was before flying. The change in the viewing context of the virtual body as it 
glides down takes place over time, so that the user is made aware of the change in 
position and orientation of the viewing context. The speed coupled flying technique 
allows the user to adjust the user's viewing context and navigate to another location in 
20 the 3D environment in a single input motion using the same drive controls. 

The virtual body eventually lands at a point in the 3D environment 60 at the 
bottom of a viewing frustum when the deselection is made. As illustrated in Fig. 5, the 
virtual body 64 glides down to the bottom of a viewing frustum 68 in front of the object 
66. Alternatively, the virtual body 64 may glide down to an object or thing that the user 
25 was viewing as opposed to the bottom of the viewing frustum 68. The user can then 

employ object inspection techniques to inspect the object 66. 

Fig. 6 illustrates an object inspection technique referred to as orbiting. Orbiting 
allows a user to easily get desired viewpoints of particular target objects. When the user 
clicks and drags on an object, the object animates to the center of the screen and the user 
30 is switched to a mode of environmental state navigation. In this mode, dragging the 
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input device forward/backward moves the virtual body toward/away from the object, 
while dragging the input device left/right causes the user to move around a circle parallel 
to the ground plane and centered at the object, always keeping the viewpoint fixed on 
that object. Fig. 6 illustrates a top view of a virtual body 70 as it orbits around an object 

5 72. As can be seen from the figure, the virtual body can move toward and away from the 

object 72 in addition to orbiting around the object in the same continuous motion. The 
orbiting technique couples the input driving controls to the state of the virtual body 30 
and the select/deselect input to the state of the object. Once the user deselects the object 
72, the new position and orientation of the virtual body 70 is retained. The change in the 

1 0 viewing context of the virtual body can take place over time, so that the user is made 
aware in the change in position and orientation of the viewing context. In an alternate 
aspect of the invention, the virtual body 70 can move back to its original position and 
orientation before selecting the object 72. The user can navigate around the object in a 
single input motion using the same drive controls. 

1 5 Figs. 7-8 illustrate another navigation technique (hereinafter referred to as cc the 

object manipulation technique") in accordance with the present invention. In the object 
manipulation technique, the user selects and drags on an object and manipulates a copy 
of the object, placing it in a position and an orientation, which the user would like to 
view the object. When the object is deselected, the copy fades away and the virtual body 

20 animates to the appropriate position and orientation in the 3D environment to attain the 
desired viewpoint of the object. The object manipulation technique couples the input 
drive controls 14 to the object state 26 once the object is selected. 

As illustrated in Fig. 7, a virtual camera or virtual body 82 has a viewing point 
specified by the position and orientation of the virtual body 82 into a 3D environment 

25 80. The initial viewing context is into the 3D environment 80 along a Z-axis. A user 

may select an object 86 by placing a cursor 84 over the object 86 employing an input 
device (e.g., a computer mouse). The user can then drag the object 86 into the 3D 
environment 80 creating a ghost copy 88 of the object 86. The ghost copy 88 can then 
be manipulated with respect to orientation and position of the object within the 3D 

30 environment 80. Once the object is deselected, the virtual body 82 moves to a new 



11 



MS 160340.1 



position and orientation in the 3D environment 80. The virtual body 82 moves to a new 
viewing location based on the position and orientation of the ghost copy 88 with respect 
to the object 86. The virtual body movement takes place as an animation over time (e.g., 
1 second) along a path P, so that the user is made aware of the change of position and 
5 orientation of the virtual body 82. In the example of Fig. 7, the viewing context is 

modified into the 3D environment 80 axially along an X-axis. It is to be appreciated that 
the viewing context can be modified along any or all of the X, Y and Z-axes. 

Fig. 8 is a top view of a 3D navigation environment 90 illustrating navigation 
within the 3D environment by manipulation of a copy of an object 1 10. A virtual body 
1 0 or camera 92 is located in a first virtual body position and orientation 94 with a viewing 
context of the object 1 10 in a first position and orientation 1 12. The object 1 10 is then 
selected and dragged on creating a ghost copy (Gl). The ghost copy Gl is rotated 
counterclockwise and moved to a second object position and orientation 1 14. Upon 
deselection of the object 1 10, the virtual body 92 is moved along a path to a second 
1 5 virtual body position and orientation 96 based on the second object position and 

orientation 1 14 with respect to the orientation and position 1 12 of the original object 
110. The object 1 10 is then selected and dragged on creating a ghost copy (G2), which 
is then rotated counterclockwise and moved to a third object position and orientation 
1 16. Upon deselection of the object 1 10, the virtual body 92 is moved along a path to a 
20 third virtual body position and orientation 98 based on the third object position and 
orientation 1 16 with respect to the orientation and position 1 12 of the original object 
1 1 0. The object 1 1 0 is then selected and dragged on creating a ghost copy (G3), which 
is then rotated counterclockwise and moved to a fourth object position and orientation 
118. Upon deselection of the object 1 1 0, the virtual body 92 is moved along a path to a 
25 fourth virtual body position and orientation 1 00 based on the fourth object position and 
orientation 118 with respect to the orientation and position 1 12 of the original object 
1 1 0. During each movement of the state of the object 1 1 0, the virtual body 92 is moved 
to a new position and orientation providing the virtual body 92 with a different viewing 
context upon each move. Each move can be accomplished in a single input motion 
30 using the same drive control. 
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Fig. 9 illustrates an alternate navigation technique (hereinafter referred to as the 
"the ghost copy technique"). In the ghost copy technique, the user drags and 
manipulates multiple copies of an object so as to get multiple simultaneous viewpoints 
of the object and the environment surrounding the object. The user can then be provided 

5 with multiple viewing contexts from which to view the object and the environment. 

Once the user deselects the object or selects another object, the copies are destroyed. 
Fig. 9 is a top view of a 3D navigation environment 120 illustrating navigation within 
the 3D environment by the ghost copy technique. A virtual body or camera 126 is 
located in the 3D environment 120 with a viewing context including a view of an object 

10 122 in a first object position and orientation. The object 122 is then selected and 

dragged on creating a ghost copy (Gl), which is then rotated counterclockwise and 
moved to a second object position and orientation, which creates a second virtual body 
or camera 124 with a different viewing context than the first virtual body 126. The 
object is then dragged in a diagonal direction creating a ghost copy (G2) which is rotated 

1 5 clockwise twice to a third object position and orientation creating a third virtual body 

130 with another viewing context different from the first and second virtual bodies 126 
and 124, respectively. The object 122 is then dragged in a diagonal direction creating a 
ghost copy (G3) which is rotated clockwise to a fourth object position and orientation 
creating a fourth virtual body 128 with another viewing context different from any of the 

20 other virtual bodies. During creation and manipulation of the ghost copies and the 

creating of other virtual bodies and viewing contexts, the object 122 remains in its 
original position and orientation. Once the object 122 is deselected, the ghost copies are 
destroyed. Each ghost copy and each viewing context can be provided by a single input 
motion using the same drive controls. 

25 Fig. 10 illustrates another navigation technique (hereinafter referred to as the "the 

possession navigation technique"). It is appreciated that existing techniques do not 
allow the user to see the 3D world from the point of view of another actor or object. In 
the possession technique, the user selects an object to move to the exact position and 
orientation of that object, thereby possessing the object and viewing the 3D environment 

30 from the point of view of the object. The virtual body state takes on the state of the 
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object that it possesses. The viewing context can take on the main pivot point of the 
object looking forward for objects that rotate. 

Fig. 10 is a top view of a 3D navigation environment 140 illustrating navigation 
within the 3D environment by the possession technique. A virtual body or camera 142 is 

5 located in the 3D environment 140 in a first virtual body position and orientation with a 

viewing context including a view of an object 144 in a first object position and 
orientation. The user then selects the object 144 in its first position and orientation and 
possesses the object 144 inheriting the objects position and orientation. The virtual body 
142 then is provided with a viewing context from the point of view of the object 144. 

10 The virtual body 142 then selects a second object 146 and possesses the second object, 
which automatically abandons the viewing context from the point of view of the object 
144. Once the object is possessed the virtual body 142 within the object can be rotated 
for locating additional objects. The virtual body 142 then selects and possesses a third 
object 148 providing the virtual body 142 with a viewing context from the third object 

15 148, which automatically abandons the viewing context from the point of view of the 

object 146. The virtual body 142 then selects and possesses a fourth object 150 
providing the virtual body 142 with a viewing context from the fourth object, which 
automatically abandons the viewing context from the point of view of the object 148. 
The virtual body 142 can be moved around through the environment 140 by selecting 

20 and possessing various objects. It is to be appreciated that the possession navigation 
technique can be integrated into the object manipulation technique, such that the user 
can move objects and possess those objects within the 3D environment changing the 
viewing context as experienced by the user. Each move and change in viewing context 
can be accomplished in a single input motion using the same drive control. 

25 Additionally, the change in the viewing context can take place over time, so that the user 

is made aware of the change in position and orientation of the viewing context. 

Fig. 1 1 illustrates a navigation technique (hereinafter referred to as "the inverse 
fog technique") in a 3D environment 160 in accordance with one aspect of the invention. 
As illustrated in Fig. 1 1, a virtual camera or virtual body 162 has a viewing point 

30 specified by the position and orientation of the virtual body 1 62 into the 3D environment 
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1 60. The user controls a radius 1 66 of a circle or sphere centered on the virtual body 
1 62. Objects 1 64 that fall within the radius 1 66 are made transparent such that objects 
1 68 outside the radius 1 66 are viewable within the viewing context of the user. The 
inverse fog technique couples the input drive controls to the object states such that the 

5 object states can be changed by moving the virtual body 1 62 through the 3D 

environment 160 and transforming the objects within the radius 166 to a state of 
transparency. Alternatively, the virtual body 162 can be stationary and the radius 166 
controllable by the input driving device. It is to be appreciated that the function of 
movement of the virtual body 162 and the radius 166 can be combined in a variety of 

10 manners. 

Fig. 12 illustrates a navigation technique (hereinafter referred to as ct the inverse 
scaling technique") in a 3D environment 170 in accordance with one aspect of the 
invention. As illustrated in Fig. 12, a virtual camera or virtual body 172 has a viewing 
point specified by the position and orientation of the virtual body 172 into the 3D 

1 5 environment 1 70. The user controls a radius 1 76 of a circle or sphere centered on the 

virtual body 1 72. Objects 1 74 that fall within the sphere are scaled down or made 
smaller and objects outside the radius are scaled up or made larger, such that objects 178 
outside the radius 176 are viewable within the viewing context of the user. The scale 
factor is based on the distance between the virtual body 172 and each object. This 

20 allows objects that are far away to be enlarged enough to fall within the viewing context. 

The inverse scaling technique couples the input drive controls to the state of the objects, 
such that the object state can be changed to a reduced size by moving the virtual body 
172 through the 3D environment 170 and thus the radius 176 transforms the objects 
within the radius to a reduced size state. Alternatively, the virtual body 172 can be 

25 stationary and the radius 1 76 controllable by the input driving device. 

Figs. 13-15 illustrate yet another navigation technique (hereinafter referred to as 
"ephemeral world compression") in which the environment state is coupled to the input 
drive controls, such that the user can compress the 3D environment and view objects that 
reside behind the user's original field of view. Fig. 13 illustrates a top view of a 3D 

30 environment 1 80 in which a virtual body or camera 1 82 resides in the 3D environment 



15 



MS 160340.1 



1 80. A number of objects 1 84 reside in the 3D environment 1 80 that are viewable by the 
virtual body 1 82 within the current viewing context. A number of objects are behind the 
virtual body 1 82 such that the objects are not within the field of view or viewing context 
of the virtual body 1 82. The virtual body 1 82 includes a number of objects 1 86 that are 
5 to the left of a central axis 1 90 of the virtual body 1 82 and behind the virtual body 1 82. 

The virtual body 1 82 also includes a number of objects 188 that are to the right of the 
central axis 190 and behind the virtual body 182. Fig. 14 illustrates the viewing context 
as experience by the user through the virtual body 1 82. The objects 1 84 and a ground 
plane 192 are within the viewing context of the virtual body 1 82. 

10 In ephemeral world compression, the user is given the ability to compress the 

world down to facilitate an understanding of the structures of the 3D environment or 
facilitating the search for objects. The user can compress the 3D world radially around 
the viewing body, so that all the objects fit within the viewing frustum. The user can 
then navigate within the compressed environment and return the world to normal when 

1 5 the user is in a desired location within the 3D environment. Fig. 1 5 illustrates a viewing 

context in which the 3D world is radially compressed into a single view by coupling the 
input driving control to the environment state. The viewing context includes objects that 
previously were not viewable by the virtual body 1 82. A first separation bar 1 87 is 
provided to illustrate the previously viewable objects 1 84 and the objects 1 86 that were 

20 previously unviewable because they were located to the left of the central axis 1 90 

behind the virtual body 1 82. A second separation bar 1 89 is provided to illustrate the 
previously viewable objects 1 84 and the objects 1 88 that were previously unviewable 
because they were located to the right of the central axis 1 90 behind the virtual body 
182. Additionally, the ground plane 192 is compressed to provide a more realistic 

25 environment. The user can then navigate the virtual body 1 82 through the compressed 

environment until the user reaches a desired location. The user can then deselect the 
compression technique returning the 3D environment 180 to normal. Compression of 
the 3D world and movement through the compressed 3D world can be accomplished in a 
single input motion using the same drive control. Additionally, the compression and 

30 decompression of the 3D world can take place over time, so that the user is made aware 
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of the change in position and orientation of the viewing context. 

Fig. 16 illustrates a block diagram of a system 200 implementing the invention in 
accordance with an aspect of the invention. The system 200 includes a processor 204 
coupled to a user input device 202 and a display 206. The user input device 202 

5 provides input drive signals to the processor 204 for controlling the state of various 

workspace variables. The user input device 202 can be a computer mouse and/or 
keyboard or a joystick coupled to the processor 204. During execution of instructions, 
the processor 204 may access memory 208 in addition to receiving signals from the input 
device 202 and presenting images on the display 206. The memory 208 includes an 

1 0 operating system 2 1 0 that provides an environment from which a user may invoke an 
animation loop routine 212. The memory 208 includes input handling routines 214 for 
handling actions by a user with respect to the user input device 202 and storing event 
information for execution based on these actions. 

In response to invocation of the 3D navigation system, the processor 202 

15 executes the animation loop routine 212 which is an animation loop that continues until 

it is terminated by an appropriate signal by the user input device 202. Each animation 
loop cycle calls the input handling routines 214 to receive and handle the next item on an 
event queue maintained by the operating system 210. The event queue includes actions 
by the user corresponding to the user input device 202, such as keystrokes, selection 

20 events, mouse events, mouse pointer movement and events from other sources. Each 

animation cycle also includes a call to a set of workspace routines 216 to determine the 
current navigation type, the current state of the virtual body, the environment and objects 
within the environment. The workspace routines employ workspace data structures to 
determine and adjust the state of the various variables within the workspace. A virtual 

25 body position data structure 220 is provided to determine and adjust the position of the 

virtual body within the 3D environment, and a virtual body orientation data structure 224 
is provided to determine and adjust the orientation of the virtual body within the 3D 
environment. The memory 208 also includes a set of object data structures 222 that 
allow the workspace routines to determine and adjust the state of any selected objects 

30 within the 3D environment. For example, each object data structure can provide a 
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description that includes position, orientation, size, shape, transparency and other states 
about the object within the 3D environment of which the object gets rendered. Finally, 
the memory 208 includes environment data structures 2 1 8 that allow the state of the 
environment to be determined and adjusted in accordance with one or more navigation 
5 types. 

In view of the foregoing structural and functional features described above, a 
methodology in accordance with various aspects of the present invention will be better 
appreciated with reference to Fig. 17. While, for purposes of simplicity of explanation, 
the methodology of Fig. 17 is shown and described as executing serially, it is to be 

1 0 understood and appreciated that the present invention is not limited by the illustrated 

order, as some aspects could, in accordance with the present invention, occur in different 
orders and/or concurrently with other aspects from that shown and described herein. 
Moreover, not all illustrated features may be required to implement a methodology in 
accordance with an aspect the present invention. It is further to be appreciated that the 

1 5 following methodology may be implemented as computer-executable instructions, such 

as software stored in a computer-readable medium. Alternatively, the methodology may 
be implemented as hardware or a combination of hardware and software. 

Fig. 17 illustrates one particular methodology for providing navigation within a 
3D environment in accordance with the present invention. The methodology begins at 

20 300 where a navigation type is determined. The navigation type can be determined in a 

variety of manners. For example, function keys on the keyboard can be provided to 
allow a user to select the navigation type, or the user can be provided with a menu of 
navigation types by invoking a function key on a keyboard, right clicking on a computer 
mouse pointer or a selectable button on a joystick. The navigation type can also be 

25 invoked automatically or be preset prior to invocation of the 3D environment. For 

example, dragging within the environment can invoke one navigation type and dragging 
on an object can invoke another navigation type. At 3 10, the input drive controls are 
coupled to the state of at least one workspace variable based on the navigation type. The 
3D environment is then rendered through an animation loop or the like based on the 

30 initial viewing context and the initial state of the workspace variables at 320. The 
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methodology then proceeds to 330 where the state of the at least one workspace 
variables is adjusted through invocation of the input drive control device. At 340, the 
environment is again rendered based on the new viewing context and new state of the at 
least one workspace variable. 
5 The present invention can be practiced in the context of a 3D interactive graphics 

programming environment, such as Alice. Alice was built for Windows 95/98/NT by 
the Stage 3 Research Group at Carnegie Mellon University. Worlds created in Alice can 
be viewed and interacted with inside of a standard web browser or the like. Alice is 
primarily a scripting and prototyping environment for 3D object behavior. Scripts can 
10 control object appearance and behavior, and while the scripts are executing, objects 

respond to user input via a mouse and keyboard. Figs. 1 8-21 illustrate a 3D amusement 
park environment designed utilizing Alice tools. Fig. 1 8 illustrates a first viewing 
context 370 of a virtual camera or the like when a user views the 3D environment along 
a ground plane. Fig. 19 illustrates a second viewing context 380 when the user invokes 
1 5 the speed-coupled flying technique and is provided with a global view of the 3D 

environment. Fig. 20 illustrates a third viewing context 390 after the user has glided 
down to a ground plane in front of an object after navigating through the environment by 
the speed-coupled flying technique. 

With reference to Fig. 21, an exemplary system for implementing the invention 
20 includes a conventional personal or server computer 420, including a processing unit 42 1 , 

a system memory 422, and a system bus 423 that couples various system components 
including the system memory to the processing unit 42 1 . The processing unit may be any 
of various commercially available processors, including Intel x86, Pentium and 
compatible microprocessors from Intel and others, including Cyrix, AMD and Nexgen; 
25 Alpha from Digital; MIPS from MIPS Technology, NEC, IDT, Siemens, and others; and 

the PowerPC from IBM and Motorola. Dual microprocessors and other multi-processor 
architectures also can be used as the processing unit 42 1 . 

The system bus may be any of several types of bus structure including a memory 
bus or memory controller, a peripheral bus, and a local bus using any of a variety of 
30 conventional bus architectures such as PCI, VESA, MicroChannel, ISA and EISA, to 
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name a few. The system memory includes read only memory (ROM) 424 and random 
access memory (RAM) 425. A basic input/output system (BIOS), containing the basic 
routines that help to transfer information between elements within the computer 420, such 
as during start-up, is stored in ROM 424. 

5 The computer 420 further includes a hard disk drive 427, a magnetic disk drive 

428, e.g., to read from or write to a removable disk 429, and an optical disk drive 430, 
e.g., for reading a CD-ROM disk 431 or to read from or write to other optical media. The 
hard disk drive 427, magnetic disk drive 428, and optical disk drive 430 are connected to 
the system bus 423 by a hard disk drive interface 432, a magnetic disk drive interface 

10 433, and an optical drive interface 434, respectively. The drives and their associated 

computer-readable media provide nonvolatile storage of data, data structures, computer- 
executable instructions, etc. for the server computer 420. Although the description of 
computer-readable media above refers to a hard disk, a removable magnetic disk and a 
CD, it should be appreciated by those skilled in the art that other types of media which are 

15 readable by a computer, such as magnetic cassettes, flash memory cards, digital video 

disks, Bernoulli cartridges, and the like, may also be used in the exemplary operating 
environment. 

A number of program modules may be stored in the drives and RAM 425, 
including an operating system 435, one or more application programs 436, other program 

20 modules 437, and program data 438. A user may enter commands and information into 
the computer 420 through a keyboard 440 and pointing device, such as a mouse 442. 
Other input devices (not shown) may include a microphone, joystick, game pad, satellite 
dish, scanner, or the like. These and other input devices are often connected to the 
processing unit 42 1 through a serial port interface 446 that is coupled to the system bus, 

25 but may be connected by other interfaces, such as a parallel port, game port or a universal 
serial bus (USB). A monitor 447 or other type of display device is also connected to the 
system bus 423 via an interface, such as a video adapter 448. In addition to the monitor, 
computers typically include other peripheral output devices (not shown), such as speakers 
and printers. 

30 The computer 420 may operate in a networked environment using logical 
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connections to one or more remote computers, such as a remote server or client computer 
449. The remote computer 449 may be a workstation, a server computer, a router, a peer 
device or other common network node, and typically includes many or all of the elements 
described relative to the computer 420, although only a memory storage device 450 has 
5 been illustrated in Fig. 21. The logical connections depicted in Fig. 21 include a local 
area network (LAN) 45 1 and a wide area network (WAN) 452. Such networking 
environments are commonplace in offices, enterprise-wide computer networks, intranets 
and the Internet. 

When used in a LAN networking environment, the computer 420 is connected to 

1 0 the local network 45 1 through a network interface or adapter 453. When used in a WAN 
networking environment, the server computer 420 typically includes a modem 454, or is 
connected to a communications server on the LAN, or has other means for establishing 
communications over the wide area network 452, such as the Internet. The modem 454, 
which may be internal or external, is connected to the system bus 423 via the serial port 

15 interface 446. In a networked environment, program modules depicted relative to the 

computer 420, or portions thereof, may be stored in the remote memory storage device. It 
will be appreciated that the network connections shown are exemplary and other means of 
establishing a communications link between the computers may be used. 

In accordance with practices of persons skilled in the art of computer 

20 programming, the present invention is described below with reference to acts and 

symbolic representations of operations that are performed by the computer 420, unless 
indicated otherwise. Such acts and operations are sometimes referred to as being 
computer-executed. It will be appreciated that the acts and symbolically represented 
operations include the manipulation by the processing unit 421 of electrical signals 

25 representing data bits which causes a resulting transformation or reduction of the 

electrical signal representation, and the maintenance of data bits at memory locations in 
the memory system (including the system memory 422, hard drive 427, floppy disks 429, 
and CD-ROM 431) to thereby reconfigure or otherwise alter the computer system's 
operation, as well as other processing of signals. The memory locations where data bits 

30 are maintained are physical locations that have particular electrical, magnetic, or optical 



21 



MS 160340.1 



properties corresponding to the data bits. 

The present invention has been illustrated with respect to a programming 
methodology and/or computer architecture and a particular example, however, it is to be 
appreciated that various programming methodology and/or computer architecture suitable 
5 for carrying out the present invention may be employed and are intended to fall within the 
scope of the hereto appended claims. 

The invention has been described with reference to the preferred aspects of the 
invention. Obviously, modifications and alterations will occur to others upon reading and 
understanding the foregone detailed description. It is intended that the invention be 
10 construed as including all such modifications alterations, and equivalents thereof. 
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